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Abstract 

In this paper we survey the almost sure central limit theorem and its functional form 

(quenched) for stationary and ergodic processes. For additive functionals of a stationary 

and ergodic Markov chain these theorems are known under the terminology of central limit 

theorem and its functional form, started at a point. All these results have in common that 

they are obtained via a martingale approximation in the almost sure sense. We point out 
OO 

"^ ■ Markov chains, Metropolis Hastings algorithms. 

O 

m 

>. 

1 Introduction and general considerations 



£ 



several applications of these results to classes of mixing sequences, shift processes, reversible 



In recent years there has been an intense effort towards a better understanding of the struc- 
ture and asymptotic behavior of stochastic processes. For dependent sequences there are 
two basic techniques: approximation with independent random variables or with martingales. 
Each of these methods have its own strength. On one hand the processes that can be treated 
by coupling with an independent sequence exhibit faster rates of convergence in various limit 
theorems; on the other hand the class of processes that can be treated by a martingale ap- 
proximation is larger. There are plenty of processes that benefit from approximation with a 
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martingale. Examples are: linear processes with martingale innovations, functions of linear 
processes, reversible Markov chains, normal Markov chains, various dynamical systems and 
the discrete Fourier transform of general stationary sequences. A martingale approximation 
provides important information about these structures because of their rich properties. They 
satisfy a broad range of inequalities, they can be embedded into Brownian motion and they 
satisfy various asymptotic results such as the functional conditional central limit theorem and 
the law of the iterated logarithm. Moreover, martingale approximation provides a simple 
and unified approach to asymptotic results for many dependence structures. For all these 
reasons, in recent years martingale approximation, "coupling with a martingale", has gained 
a prominent role in analyzing dependent data. This is also due to important developments 
by Liverani (1996), Maxwell- Woodroofe (2000), Derriennic-Lin (2001 a and b, 2003), Wu- 
Woodroofe (2004) and developments by Peligrad-Utev (2005), Zhao- Woodroofe (2008 a and 
b), Volny (2007), Peligrad-Wu (2010) among others. Many of these new results, originally de- 
signed for Markov operators, (see Kipnis-Varadhan, 1986; Derriennic-Lin, 2001 b) have made 
their way into limit theorems for stochastic processes. 

This method has been shown to be well suited to transport from the martingale to the 
stationary process either the conditional central limit theorem or conditional invariance prin- 
ciple in probability. As a matter of fact, papers by Dedecker-Merlevede- Volny (2007), Zhao 
and Woodroofe (2008 b), Gordin and Peligrad (2011), point out characterizations of stochas- 
tic processes that can be approximated by martingales in quadratic mean. These results are 
useful to treat evolutions in "annealed" media. 

In this survey we address the question of limit theorems started at a point for almost all 
points. These type of results are also known under the name of quenched limit theorems or 
almost sure conditional invariance principles. Limit theorems for stochastic processes that do 
not start from equilibrium is timely and motivated by recent development in evolutions in 
quenched random environment, random walks in random media, for instance as in Rassoul- 
Agha and Seppalainen (2007). Moreover recent discoveries by Volny and Woodroofe (2010 a) 
show that many of the central limit theorems satisfied by classes of stochastic processes in 
equilibrium, fail to hold when the processes are started from a point. Special attention will 
be devoted to normal and reversible Markov chains and several results and open problems 
will be pointed out. These results are very important since reversible Markov chains have 
applications to statistical mechanics and to Metropolis Hastings algorithms used in Monte 
Carlo simulations. The method of proof of this type of limiting results are approximations 
with martingale in an almost sure sense. 

The field of limit theorems for stochastic processes is closely related to ergodic theory and 
dynamical systems. All the results for stationary sequences can be translated in the language 



of Markov operators. 

2 Limit theorems started at a point via martingale ap- 
proximation 

In this section we shall use the framework of strictly stationary sequences adapted to a 
stationary nitrations that can be introduced in several equivalent ways, either by using a 
measure preserving transformation or as a functional of a Markov chain with a general state 
space. It is just a difference of language to present the theory in terms of stationary processes 
or functionals of Markov chains. 

Let (Q, A, P) be a probability space, and T : Q i— > Q be a bijective bimeasurable transfor- 
mation preserving the probability P. A set A e A is said to be invariant if T(A) = A. We 
denote by X the <7-algebra of all invariant sets. The transformation T is ergodic with respect 
to probability P if each element of X has measure or 1. Let X"o be a a-algebra of A satisfying 
Xo Q T _1 (Xo) and define the nondecreasing filtration (X"j)j 6 z by T% = T~*(Xo). Let Xo be a 
Xo-measurable, square integrable and centered random variable. Define the sequence (Xj) iG ^ 
by Xj = X o T\ Let S n — Xi + ■ ■ ■ + X n . For p > 1, || . \\ p denotes the norm in L p (f2, A, P). In 
the sequel we shall denote by Eo(X) = E(X|Xo). 

The conditional central limit theorem plays an essential role in probability theory and 
statistics. It asserts that the central limit theorem holds in probability under the measure 
conditioned by the past of the process. More precisely this means that for any function / 
which is continuous and bounded we have 

E (/(S n /v^)) -► E(/(cr7V)) in probability, (2.1) 

where N is a standard normal variable and a is a positive constant. Usually we shall have the 
interpretation a 2 = lim n _^ 00 var(S' n )/n. 

This conditional form of the CLT is a stable type of convergence that makes possible the 
change of measure with a majorizing measure, as discussed in Billingsley (1968), Rootzen 
(1976), and Hall and Heyde (1980). Furthermore, if we consider the associated stochastic 
process 

W n (t) = j=S [nt] , 



where [x] denotes the integer part of x, then the conditional CLT implies the convergence 
of the finite dimensional distributions of W n (t) to those of aW(t) where W(t) is the stan- 
dard Brownian Motion; this constitutes an important step in establishing the functional CLT 



(FCLT). Note that W n (t) belongs to the space D[0, 1], the set of functions on [0, 1] which are 
right continuous and have left hands limits. We endow this space with the uniform topology. 
By the conditional functional central limit theorem we understand that for any function / 
continuous and bounded on D[0, 1] we have 

Eo(/(W n )) -»■ E(f(aW)) in probability. (2.2) 

There is a considerable amount of research concerning this problem. We mention papers by 
Dedecker and Merlevede (2002), Wu and Woodroofe (2004) and Zhao and Woodroofe (2008 
b) among others. 

The quenched versions of these theorems are obtained by replacing the convergence in 
probability by convergence almost sure. In other words the almost sure conditional theorem 
states that, on a set of probability one, for any function / which is continuous and bounded 
we have 

Mf(S n /Vn))^E(f(aN)), (2.3) 

while by almost sure conditional functional central limit theorem we understand that, on a 
set of probability one, for any function / continuous and bounded on D[0, 1] we have 

E (f(W n ))^E(f(aW)). (2.4) 

We introduce now the stationary process as a functional of a Markov chain. 

We assume that (£ n )nez is a stationary ergodic Markov chain defined on a probability 
space (Q, J 7 , P) with values in a Polish space (S,S). The marginal distribution is denoted 
by n(A) = P(£ e A), A e S. Next, let L^(vr) be the set of functions h such that \\h\\l iV = 
J h 2 dir < oo and J hdn = 0. Denote by J-Jt the u-field generated by £j with j < k, Xj = h(£j). 
Notice that any stationary sequence (Ifc)fcez can be viewed as a function of a Markov process 
£& = (Yj'j < k) with the function <?(£&) = Yk- Therefore the theory of stationary processes 
can be imbedded in the theory of Markov chains. 

In this context by the central limit theorem started at a point (quenched) we understand 
the following fact: let F x be the probability associated with the process started from x and let 
K x be the corresponding expectation. Then, for n— almost every x, for every continuous and 
bounded function /, 

E x (f(S n /V^))^Hf(vN)). (2.5) 

By the functional CLT started at a point we understand that, for n— almost every x, for every 
function / continuous and bounded on D[0, 1], 

E*(/(wg)->E(/(<rW0). (2.6) 



where, as before W is the standard Brownian motion on [0, 1]. 

It is remarkable that a martingale with square integrable stationary and ergodic differences 
satisfies the quenched CLT in its functional form. For a complete and careful proof of this 
last fact we direct to Derriennic and Lin (2001 a, page 520). This is the reason why a fruitful 
approach to find classes of processes for which quenched limit theorems hold is to approximate 
partial sums by a martingale. 

The martingale approximation as a tool in studying the asymptotic behavior of the par- 
tial sums S n of stationary stochastic processes goes back to Gordin (1969) who proposed 
decomposing the original stationary sequence into a square integrable stationary martingale 
M n = Y^i=\ Di adapted to (J 1 ^), such that S n = M n + R n where R n is a telescoping sum of 
random variables, with the basic property that sup n ||-R n ||2 < °o. 

For proving conditional CLT for stationary sequences, a weaker form of martingale approx- 
imation was pointed out by many authors (see for instance Merlevede-Peligrad-Utev, 2006 for 
a survey). 

An important step forward was the result by Heyde (1974) who found sufficient conditions 
for the decomposition 

S n = M n + Rn with Rn/Vn ->■ in L 2 . (2.7) 

Recently, papers by Dedecker-Merlevede-Volny (2007) and by Zhao-Woodroofe (2008 b) deal 
with necessary and sufficient conditions for martingale approximation with an error term as 
in (ED . 

The approximation of type (12.71) is important since it makes possible to transfer from 
martingale the conditional CLT defined in (12. lft . where a = 1 1 -Do 1 1 2 - 

The theory was extended recently in Gordin- Peligr ad (2011) who developed necessary and 
sufficient conditions for a martingale decomposition with the error term satisfying 

max \Sj -MA/y/n ->■ in JL 2 . (2.8) 

l<jf<n 

This approximation makes possible the transport from the martingale to the stationary process 
the conditional functional central limit theorem stated in f 12 . 2 j) . These results were surveyed 
in Peligrad (2010). 

The martingale approximation of the type ( 12. 8 p brings together many disparate examples 
in probability theory. For instance, it is satisfied under Hannan (1973, 1979) and Heyde (1974) 
projective condition. 

00 
EtXolJloo) = almost surely and J^ P-i(-Xo) - E_ < _ 1 (X )|| 2 < 00; (2.9) 



It is also satisfied for classes of mixing processes; additive functionals of Markov chains with 
normal or symmetric Markov operators. 

A very important question is to establish quenched version of conditional CLT and con- 
ditional FCLT, i.e. the invariance principles as in (12. 3 p and also in (12 Ah (or equivalently as 
in (12. 5 p and also in ( 12. 6p ). There are many examples of stochastic processes satisfying ( 12. 8 j) 
for which the conditional CLT does not hold in the almost sure sense. For instance condition 
( 12. 9 p is not sufficient for (12. 3p as pointed out by Volny and Woodroofe (2010 a). In order to 
transport from the martingale to the stationary process the almost sure invariance principles 
the task is to investigate the approximations of types (12. 7\\ or ( I2.8P with an error term well 
adjusted to handle this type of transport. These approximations should be of the type, for 
every e > 

F [\S n - AfJA/n > e] ->■ a.s. or P [max \Si - M^/y/n > e) ->■ a.s. (2.10) 

l<i<n 

where (M n ) n is a martingale with stationary and ergodic differences and we used the notation 
Po(^4) = P(A|J r o). They are implied in particular by stronger approximations such that 

\S n — M n \/\/n — > a.s. or max \Si — Mj|/ \/n — > a.s. 

l<i<n 

Approximations of these types have been considered in papers by Zhao- Woodroofe (2008 a), 
Cuny (2011), Merlevede- Peligrad M.- Peligrad C (2011) among others. 

In the next subsection we survey resent results and point out several classes of stochastic 
processes for which approximations of the type (I2.10p hold. 

For cases where a stationary martingale approximation does not exist or cannot be pointed 
out, a nonstationary martingale approximation is a powerful tool. This method was occasion- 
ally used to analyze a stochastic process. Many ideas are helpful in this situation ranging 
from simple projective decomposition of sums as in Gordin and Lifshitz (1981) to more so- 
phisticated tools. One idea is to divide the variables into blocks and then to approximate 
the sums of variables in each block by a martingale difference, usually introducing a new 
parameter, the block size, and changing the filtration. This method was successfully used in 
the literature by Philipp-Stout (1975), Shao (1995), Merlevede-Peligrad (2006), among others. 
Alternatively, one can proceed as in Wu- Woodroofe (2004), who constructed a nonstationary 
martingale approximation for a class of stationary processes without partitioning the variables 
into blocks. 

Recently Dedecker-Merlevede-Peligrad (2012) used a combination of blocking technique 
and a row-wise stationary martingale decomposition in order to enlarge the class of random 
variables known to satisfy the quenched invariance principles. To describe this approach, 



roughly speaking, one considers an integer m = m(n) large but such that n/m — > oo. Then one 
forms the partial sums in consecutive blocks of size m, YJ 1 = X m (j^ + i +....+X m j, 1 < j < k, 
k = [n/m]. Finally, one considers the decomposition 

S n = M2 + I%, (2.11) 

n 

where M™ = y^D™, with D™ = YJ 1 — E(YJ l \ J-" m (j_i)) a triangular array of row- wise stationary 
martingale differences. 

2.1 Functional Central limit theorem started at a point under 
projective criteria. 

We have commented that condition (12. 9ft is not sufficient for the validity of the almost sure 
CLT started from a point. Here is a short history of the quenched CLT under projective 
criteria. A result in Borodin and Ibragimov (1994, ch.4, section 8) states that if ||Eo(>S'n)||2 is 
bounded, then the CLT in its functional form started at a point (12 .4p holds. Later, Derriennic- 
Lin (2001 a and b, 2003) improved on this result imposing the condition | |Eo(S' n ) 1 12 = 0(n 1 ^ 2 ^ t ) 
with e > (see also Rassoul-Agha and Seppalainen, 2008). A step forward was made by Cuny 
(2011) who improved the condition to ||E (S , n )|| 2 = 0(n 1//2 (logn)~ 2 (loglogn) _1_<5 ) with 5 > 0, 
by using sharp results on ergodic transforms in Gaposhkin (1996). 

We shall describe now the recent progress made on the functional central limit theorem 
started at a point under projective criteria. We give here below three classes of stationary 
sequences of centered square integrable random variables for which both quenched central 
limit theorem and its quenched functional form given in (12. 3p and (12. 4 p hold with a 2 = 
lim n ^ 00 var(S' n )/n, provided the sequences are ergodic. If the sequences are not ergodic then 
then the results still hold but with a 2 replaced by the random variable 77 described as n = 
lim n _!. 00 E(S' 2 |X)/n and E,(n) =o 2 . For simplicity we shall formulate the results below only for 
ergodic sequences. 

1. Hannan-Heyde projective criterion. Cuny-Peligrad (2012) (see also Volny-Woodroofe, 
2010 b) showed that (I2.3P holds under the condition 



E(S n |.F( 



-^= > almost surely and > ||E_j(Ao) — E_,;_i(X )||2 < 00. 

y/n ^ 



(2.12) 



The functional form of this result was established in Cuny-Volny (2013). 

2. Maxwell and Woodroofe condition. The convergence in (12. 4p holds under Maxwell- 



Woodroofe (2000) condition, 

2^ — w — ' ( 3) 

fe=i 

as recently shown in Cuny-Merlevede (2012). In particular both conditions (j2.12p and (I2.13P 
and is satisfied if 

£™<oo. ,2,4) 

fc=l 

3. Dedecker-Rio condition. In a recent paper Dedecker-Merlevede-Peligrad (2012) 
proved (12.41) under the condition 

^||X E (X fc )||i<oo. (2.15) 

fc>0 

The first two results were proved using almost sure martingale approximation of type 
(I2.10p . The third one was obtained using the large block method described in (12.111) . 

Papers by Durieu-Volny (2008) and Durieu (2009) suggest that conditions fl2TT2|) . fl2~T3|) 
and (I2.15P are independent. They have different areas of applications and they lead to optimal 
results in all these applications. Condition (12.121) is well adjusted for linear processes. It was 
shown in Peligrad and Utev (2005) that the Maxwell- Woodroofe condition (12.131) is satisfied 
by p— mixing sequences with logarithmic rate of convergence to 0. Dedecker-Rio (2000) have 
shown that condition (12.151) is verified for strongly mixing processes under a certain condition 
combining the tail probabilities of the individual summands with the size of the mixing co- 
efficients. For example, one needs a polynomial rate on the strong mixing coefficients when 
moments higher than two are available. However, the classes described by projection condi- 
tions have a much larger area of applications than mixing sequences. They can be verified by 
linear processes and dynamical systems that satisfy only weak mixing conditions (Dedecker- 
Prieur 2004 and 2005, Dedecker-Merlevede-Peligrad (2012) among others). More details about 
the applications are given in Section 3. 

Certainly, these projective conditions can easily be formulated in the language of Markov 
operators by using the fact that E (X fc ) = Q(f)((,o)- in this language Eo(Sfc) = (Q + Q 2 + ... + 

Q k )(mo). 

2.2 Functional Central limit theorem started at a point for normal 
and reversible Markov chains. 

In 1986 Kipnis and Varadhan proved the functional form of the central limit theorem as in 
(12. 2p for square integrable mean zero additive functionals / G IL^tt) of stationary reversible 
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ergodic Markov chains (£ n )nez with transition function Q(£o, A) = P(£i G A\£ ) under the 
natural assumption var(S n )/n is convergent to a positive constant. This condition has a 
simple formulation in terms of spectral measure pf of the function / with respect to self- 
adjoint operator Q associated to the reversible Markov chain, namely 

p f {dt) < oo. (2.16) 



_ x l-t 

This result was established with respect to the stationary probability law of the chain. (Self- 
adjoint means Q = Q*, where Q also denotes the operator Qf(£) = J f(x)Q(£, dx); Q* is the 
adjoint operator defined by < Qf, g >=< f, Q*g >, for every / and g in L 2 (7r)). 

The central limit theorem (12. ip for stationary and ergodic Markov chains with normal 
operator Q (QQ* = Q*Q), holds under a similar spectral assumption, as discovered by Gordin- 
Lifshitz (1981) (see also and Borodin- Ibragimov, 1994, ch. 4 sections 7-8). A sharp sufficient 
condition in this case in terms of spectral measure is 

Tpf(dz) < oo. (2.17) 

D |1 — A 

where D is the unit disk. 

Examples of reversible Markov chains frequently appear in the study of infinite systems of 
particles, random walks or processes in random media. A simple example of a normal Markov 
chain is a random walk on a compact group. Other important example of reversible Markov 
chain is the extremely versatile (independent) Metropolis Hastings Algorithm which is the 
modern base of Monte Carlo simulations. 

An important problem is to investigate the validity of the almost sure central limit theorem 
started at a point for stationary ergodic normal or reversible Markov chains. As a matter of 
fact, in their remark (1.7), Kipnis-Varadhan (1986) raised the question if their result also holds 
with respect to the law of the Markov chain started from x, for almost all x, as in (12.61) . 

Conjecture: For any square integrable mean function of reversible Markov chains 
satisfying condition (" 12. 16f) the functional central limit theorem started from a point holds for 
almost all points. The same question is raised for continuous time reversible Markov chains. 

The answer to this question for reversible Markov chains with continuous state space is 
still unknown and has generated a large amount of research. The problem of quenched CLT 
for normal stationary and ergodic Markov chains was considered by Derriennic-Lin (2001 a) 
and Cuny (2011), among others, under some reinforced assumptions on the spectral condition. 
Concerning normal Markov chains, Derriennic-Lin (2001 a) pointed out that the central limit 
theorem started at a point does not hold for almost all points under condition (I2.17p . Fur- 
thermore, Cuny-Peligrad (2012) proved that there is a stationary and ergodic normal Markov 



chain and a function / G IL^vr) such that 

f |log(|l-z|)loglog(|l-z|)| 

/ n — i pf^ dz > < °° 

Jd \ l ~ z \ 

and such that the central limit theorem started at a point fails, for it— almost all starting 
points. 

However the condition 

"' "° g+ " 1 ° S(1 - f)l)2 p / W < oc, (2.18) 

-1 i — t 

is sufficient to imply central limit theorem started at a point ( 12. 5p for reversible Markov chains 
for 7T— almost all starting points. Note that this condition is a slight reinforcement of condition 
d2HD. 

It is interesting to note that by Cuny (2011, Lemma 2.1), condition (I2.18P is equivalent to 
the following projective criterion 

y (loglQg^||E„(S„)||3 < ^ 

Similarly, condition f 12 . 1 Tj) in the case where Q is symmetric, is equivalent to 

< oo. (2.20) 

n n 

3 Applications 

Here we list several classes of stochastic processes satisfying quenched CLT and quenched 
invariance principles. They are applications of the results given in Section 2. 

3.1 Mixing processes 

In this subsection we discuss two classes of mixing sequences which are extremely relevant 
in the study of Markov chains, Gaussian processes and dynamical systems. 

We shall introduce the following mixing coefficients: For any two cr-algebras A and B define 
the strong mixing coefficient a(A,B): 

a(A, B) = sup{\F(A HB)- F(A)F(B)\; A G A, B G B}. 

The p— mixing coefficient, known also under the name of maximal coefficient of correlation 
p(A,B) is defined as: 

p(A,B) = sup{Cov(X,r)/||X|| 2 ||F|| 2 : Xeh 2 (A), Yeh 2 (B)}. 
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For the stationary sequence of random variables (X fc ) feGZ , we also define J 7 ^ the cr-field gener- 
ated by Xi with indices m < i < n, J zn denotes the a-field generated by X,i with indices i > n, 
and T m denotes the a-field generated by Xi with indices % < m. The sequences of coefficients 
a(n) and p(n) are then defined by 

a{n) = a(Jo, J 27 "), p(n) = p^F 1 ). 

An equivalent definition for p(n) is 

p(n) = sup{||E(y|J- )|| 2 /||y|| 2 : Y G L 2 (J-"),E(F) = 0}. (3.21) 

Finally we say that the stationary sequence is strongly mixing if a(n) — y as n — > oo, 
and p— mixing if p(n) — y as n — y oo. It should be mentioned that a p— mixing sequence 
is strongly mixing. Furthermore, a stationary strongly mixing sequence is ergodic. For an 
introduction to the theory of mixing sequences we direct the reader to the books by Bradley 
(2007). 

In some situations weaker forms of strong and p— mixing coefficients can be useful, when 
T n is replaced by the sigma algebra generated by only one variable, X n , denoted by J 7 ^. We 
shall use the notations a(n) = a(J r o,J-'^) and p(n) = p(J r o,J-'^). 

By verifying the conditions in Section 3, we can formulate: 

Theorem 1. Let (X n ) n£ i be a stationary and ergodic sequence of centered square integrable 
random variables. The quenched CLT and its quenched functional form as in Ii2.3\) and \2.J$ 
hold with a 2 = lim n _ )>00 var(S n )/n under one of the following three conditions: 

fit- 

£^<co. (3.23) 

k=l 

V / Q 2 (u)du < oo, (3.24) 

where Q denotes the generalized inverse of the function t —y F(\X \ > t). 

We mention that under condition (I3.23J) the condition of ergodicity is redundant. Also if 
(I3.24p holds with a(k) replaced by a(k), then the sequence is again ergodic. 

In order to prove this theorem under (13.221) one verifies condition (I2.14p via the estimate 

E(E (X k )) 2 = E(X k E (X k )) < p(k)\\X \g 

11 



which follows easily from the definition of p. 

Condition (I3.23|) is used to verify condition (I2.13p . This was verified in the Peligrad-Utev- 
Wu (2007) via the inequalities 

r 

\\E(S 2 r + ^ )\\ 2 < C J2^ /2 P^) 

j=0 

and 

E l|E(g lJf 0)l ' 2 < ef>(y) < oo. (3.25) 

r=0 j=0 

Furthermore (I3.25J) easily implies f 1 2 . X 3 j) . For more details on this computation we also direct 
the reader to the survey paper by Merlevede-Peligrad-Utev (2006). 

To get the quenched results under condition (13.241) the condition (I2.15P is verified via the 
following identity taken from Dedecker-Rio (2000, (6.1)) 

E\X E(X k \T )\ = Cov(\X Q \(I m x k \T () )>o} ~ / {E (x fc |.F )<o}),X fc ). (3.26) 

By applying now Rio's (1993) covariance inequality we obtain 

a(k) 



E|XoE(X fc |J- )| < c / Q 2 (u)du. 
Jo 



It is obvious that condition H 3 . 2 2 1) requires a polynomial rate of convergence to of p(k); 
condition (I3.23J) requires only a logarithmic rate for p(n). To comment about condition f)3.24p 
it is usually used in the following two forms: 

-either the variables are almost sure bounded by a constant, and then the requirement is 

J2T=i®( k ) < °°- 

-the variables have finite moments of order 2 + 5 for some 5 > 0, and then the condition 

on mixing coefficients is YlT=i k 2 ^ s a(k) < oo. 

3.2 Shift processes. 

In this sub-section we apply condition fl 2 . 1 3 [) to linear processes which are not mixing in the 
sense of previous subsection. This class is known under the name of one-sided shift processes, 
also known under the name of Raikov sums. 

Let us consider a Bernoulli shift. Let {ek, k G Z} be an i.i.d. sequence of random variables 
with P(ei = 0) = P(£i = 1) = 1/2 and let 

oo „i 

Y n = ^2- k ~ l E n - k and X n = g(Y n ) - / g(x)dx , 
k=o Jo 
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where g G L 2 (0, 1), (0, 1) being equipped with the Lebesgue measure. 

By applying Proposition 3 in Maxwell and Woodroofe (2000) for verifying condition f !2. 13j) . 
we see that if g G L 2 (0, 1) satisfies 

/ / [0(aO - g(y)} 2 -^--(\og[\og -^--}Ydxdy < oo (3.27) 

Jo Jo \x-y\ \x-y\ 

for some t > 1, then (I2.13P is satisfied and therefore (I2.3P and (12 .4p hold with a 2 = lim„_ s . 00 var(S' n )/n. 

A concrete example of a map satisfying (13.271) . pointed out in Merlevede-Peligrad-Utev, 2006 

is 

. . 1 1 .1, 

q(x) = —=- : — — — sin( — ) , < x < 1. 

yV ' y/x [1 + log(2/x)] 4 X J ' 

3.3 Random walks on orbits of probability preserving transforma- 
tion 

The following example was considered in Derriennic-Lin (2007) and also in Cuny-Peligrad 
(2012). Let us recall the construction. 

Let t be an invertible ergodic measure preserving transformation on (S, A, tt), and denote 
by U, the unitary operator induced by r on L 2 (7r). Given a probability v = (pk)k& on Z, we 
consider the Markov operator Q with invariant measure tt, defined by 

Qf = ^2Pkf°r k , for every / G L^tt). 

fcez 

This operator is associated to the transition probability 

Q(x, A) = ^p k l A (r k s) } seS,AeA. 

fcgZ 

We assume that v is ergodic, i.e. the the group generated by {k G Z : p k > 0} is Z. As 
shown by Derriennic-Lin (2007), since r is ergodic, Q is ergodic too. We assume v is symmetric 
implying that the operator Q is symmetric. 

Denote by V the unit circle. Define the Fourier transform of v by <p(\) = Y2kezPk^ k > f° r 
every A G I\ Since v is symmetric, <f(X) G [—1, 1], and if /// denotes the spectral measure (on 
r) of / G L 2 (7r), relative to the unitary operator U, then, the spectral measure pf (on [—1, 1]) 
of /, relative to the symmetric operator Q is given by 

^{s) Pf {ds)= [ 1>(<p{\))ii f (d\), 

'-1 Jt 

for every positive Borel function ip on [—1,1]. Condition (I2.19P is verified under the assumption 



h T^W MrfAXoo. 
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and therefore (I2.5P holds. 

When v is centered and admits a moment of order 2 (i.e. Ylkez ^ 2 Pk < °°), Derriennic and 
Lin (2007) proved that the condition J r , 1 _ 1 , x -,, iXf(d\) < oo, is sufficient for (j2.5p . 

Let a G K — Q, and let r be the rotation by a on R/Z. Define a measure a on R/Z 
by o" = Ylk£zPk$ka- For that r, the canonical Markov chain associated to Q is the random 
walk on R/Z of law er. In this setting, if (c n (/)) denotes the Fourier coefficients of a function 
/ G L 2 (M/Z), condition (12TT9D reads 

y. (log + | log(l - ^(e 2 — ))|) 2 |c w (/)| 2 ^ 

> — — : < OO. 

z -' 1 - o9(e 2i7rna ) 

3.4 CLT started from a point for a Metropolis Hastings algorithm. 

In this subsection we mention a standardized example of a stationary irreducible and aperiodic 
Metropolis-Hastings algorithm with uniform marginal distribution. This type of Markov chain 
is interesting since it can easily be transformed into Markov chains with different marginal 
distributions. Markov chains of this type are often studied in the literature from different 
points of view. See, for instance Rio (2009). 

Let E = [— 1, 1] and let v be a symmetric atomless law on E. The transition probabilities 
are defined by 

Q(x,A) = (l-\x\)5 x (A) + \x\v(A), 

where S x denotes the Dirac measure. Assume that 9 = j E \x\~ l v(dx) < oo. Then there is a 
unique invariant measure 

ir(dx) = 9~ 1 \x\~ 1 v (dx) 

and the stationary Markov chain (7^) generated by Q(x, A) and n is reversible and positively 
recurrent, therefore ergodic. 

Theorem 2. Let f be a function in L^vr) satisfying f(—x) = —f{x) for any x G E, Assume 
that for some positive t, \f\ < g on [—t,t] where g is an even positive function on E such that 
g is nondecreasing on [0, 1], x~ l g(x) is nonincreasing on [0, 1] and 

/ [x~ l g{x)] 2 dx < 00. (3.28) 

Define X k = fipfk)- Then Ii2.5\) holds. 

Proof. Because the chain is Harris recurrent if the annealed CLT holds, then the CLT also 
holds for any initial distribution (see Chen, 1999), in particular started at a point. Therefore 
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it is enough to verify condition (j2.20p . Denote, as before, by F, x the expected value for the 
process started from x G E. We mention first relation (4.6) in Rio (2009). For any n > 1/t 

\® x (S n (g))\ < ng(l/n) + t' x \f(x)\ for any x G [-1, 1]. 

Then 

K(S n (g))\ 2 < 2[ng(l/n)] 2 + 2r 2 \f(x)\ 2 for any x G [-1, 1], 

and so, for any n > 1/t 

\\E*(S n )\\l 7T <2[ng(l/n)} 2 + 2t- 2 \\f(x)\\l 7T . 
Now we impose condition ( 12.201) involving ||E :c (5'„)||2 7r , and note that 



V ^ (1 {^ < oo if and only if (J22HD holds. 
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